RECOVERY OF MISSING SAMPLES IN OVERSAMPLING 

FORMULAS 
FOR BAND LIMITED FUNCTIONS 
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Abstract. In a previous paper we constructed frames and oversampling for- 
mulas for band-limited functions, in the framework of the theory of shift- 
Ch invariant spaces. In this article we study the problem of recovering missing 

samples. 

We find a sufficient condition for the recovery of a finite set of missing 
f""""'"" samples. The condition is expressed as a linear independence of the compo- 

r" H nents of a vector W over the space of trigonometric polynomials determined 

by the frequencies of the missing samples. We apply the theory to the de- 
rivative sampling of any order and we illustrate our results with a numerical 
experiment. 

a 

£3 1- Introduction 

A band-limited signal is a function which belongs to the space of functions 
in L 2 (M.) whose Fourier transforms have support in [—a;, a;]. Functions in this 
space can be represented by their Whittaker-Kotelnikov-Shannon series, which is 
the expansion in terms of the orthonormal basis of translates of the sine function. 
The coefficients of the expansion are the samples of the function at a uniform grid 
on M, with "density" lo/tt [Nyquist density). The sampling theory for band- limited 
* functions stems from this series representation and has been extended to more 

i-H general expansions, as Riesz bases and frames, formed by the translates of one or 

OO more functions. 

Let $ be a finite subset of and fix a positive real number t a . If the set of 
translates i?$,t D = { T kt a <p, <p £ 3>, k £ Z} is a frame for B^ and the set <&* of dual 
J^j functions is known, then any function can be reconstructed via the syntesis formula 

(2.1|. The elements of <I> are called generators. The coefficients of the expansion 
are samples of the convolution of the function with the elements of the dual family 

If the family is a Riesz basis, the loss of even one sample prevents the recon- 
struction, since the elements of the family -E$,t are linearly independent. On the 
contrary, if the family -E$,t is overcomplete, recovery of a finite set of samples is 
possible under suitable assumptions, because of the redundancy of the system. 

This paper deals with the problem of recovering missing samples of band- limited 
functions. We shall use the frame representation formulas constructed in [DP] in 
the framework of the theory of frames for shift-invariant spaces. 
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We recall that B u is t Q - shift-invariant for any t , i.e. is invariant under all 
translations Tkt ,k S Z, by integer multiples of t a . A finite subset $ of a t a - 
shift-invariant space S is called a set of generators if S is the closure of the space 
generated by the family -E$,t . Shift-invariant spaces can have different sets of 
generators; the smallest number of generators is called the length of the space. 

The structure of shift-invariant spaces was first investigated by C. de Boor, R. 
DeVore ,BDFi; successively A. Ron and Z. Shen introduced their Gramian analysis 
and characterized sets of generators whose translates form Bessel sequences, frames 
and Riesz bases [RSJ . Their conditions are expressed in terms of the eigenvalues 
of the Gramian matrix. More recently, building on their results, for the space B u 
we have obtained more explicit conditions and explicit formulas for the Fourier 
transforms of the dual generators [DPJ ; the same paper contains also multi-channel 
oversampling formulas for band-limited signals and an application to the first and 
second derivative oversampling formulas. These are a generalization to frames of 
the classical derivative sampling formulas, where the family E<$^ is a Riesz basis 
(see (HI] ) . The coefficients of the expansion are the values of the function and its 
derivatives at the sample points. 

In this paper we assume that E^ to is a frame for and we find sufficient 
conditions for the recovery of a finite set of missing samples. This problem has 
been investigated by P.J.S.G Ferreira in [F], where it is shown that, in the case of a 
generalized Kramer sampling, under suitable oversampling assumptions, any finite 
set of samples can be recovered from the others. Successively D.M.S. Santos and 
Ferreira |SF] considered the case of a particular two-channel derivative oversampling 
formula [SI]. The work of Santos and Ferreira has been generalized to arbitrary 
two-channels by Y. M. Hong and K. H. Kwon [KK . 

In this paper we consider general frames -E*,t D of B u where the number of ele- 
ments of $ is minimal, i.e. equal to the length of B u as t -shift invariant space, and 
find sufficient conditions for the recovery of any finite subset of missing samples. 

The paper is organized as follows. In Section 2 we introduce the pre-Gramian 
and Gramian matrices and recall some results, proved in [DPJ, that characterize 
sets of generators whose translates form frames and Riesz bases, in terms of the 
Fourier transforms of the generators. 

In Section 3 , we fix the parameter t Q and we consider a family $ = {tpx , if2 , . . . </J jv } 
of N generators, where N is the length of B u as a i D -shift-invariant space. If the 
family -E$,t is a frame and not a Riesz basis, we find sufficient conditions to re- 
construct any finite set of missing samples (see Theorems 3.4 and 3.5). This result 
makes use of the particular structure of the mixed-Gramian matrix G$ ! $* i t o associ- 
ated to $ and to the dual generators Roughly speaking, the interval [0,27r/t o ] 
is the union of two sets, where t D is either the N x N identity matrix or 

/ — Pyy, where Pyy is the orthogonal projection on a vector W in C N , which is 
the cross product of N — 1 translates of the Fourier transform of the generators 
$ (see Propositions 3.1 and 3.2 1. The recovery condition is expressed as a linear 
independence of the components of the vector W over the space of trigonometric 
polynomials determined by the frequencies of the missing samples. 
In Section 4 we find families of derivative frames of any order and apply the results 
of Section 3 to them, showing that it is possible to recover any finite set of missing 
samples. 
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2. Preliminaries 

In this section we establish notation and we collect some results on frames for 
shift-invariant spaces. The Fourier transform of a function / in L X (R) is 




The convolution of two functions / and g is / * g{x) = J f(x — y)g(y) dy, so that 

f * g = V^nf g- Let ft be a positive real number; L v h is the space of /i-periodic 
functions on R such that 

ll/lk = (^ I \f(x)\ P dx) <oo. 

In this paper vectors in C N are to be considered as column-vectors; however, to 
save space, we shall write x = {x ll X2, . . . ,Xn) to denote the column- vector whose 
components are x\, . . . ,xjy. With the symbol £ 2 (Z;C N ) we shall denote the space 
of square summable C^-valued sequences c = (c(n))z. 

Let H be a closed subspace of L 2 (R). Given a subset <& = {ipj, j = 1, . . . , TV} of H 
and a positive number t a , denote by E^>^ to the set 

E*,t. ={T nto <Pj, neZ, j = l,...,N}; 

here T a f[x) = f(x + a). The family -E$,t D is a frame for iJ if the operator T $ t : 

£ 2 (Z;C N ) — > defined by T $ t<j C = J2f=i ^2 n ez, c j( n ) T nt l Pj 1S continuous, surjec- 
tive and ran(T$ t ) is closed. It is well known that is a frame for H if and 

only if there exist two constants < A < B such that 

JV 

A\\f\\ 2 <J2H \(f>Tn to <Pi)\ 2 < B\\f\\ 2 V/ G ff. 
j=l nez 

The constants A and B are called frame bounds. Denote by T* t : H -> ^ 2 (Z; C w ) 
the adjoint of T $ t . The operator T $ t T£ t : i? — > iJ is called frame operator. 
Denote by <&* the family {ip*, j = 1, . . . , TV}, where 

= (T*, to lS, to rVi l<i<iV- 
If S$,t is a frame for H then is also a frame, called the dual frame, and 

T *,tM*,t = T **,t T £,t = L Explicitly 

JV N 
(2-1) / = ^2^2{f,r n t <Pj}T nto <Pj = ^2^2(f,T n t Vj)T nto ip* 

j=l raeZ j=l n6Z 

V/ e Note that 

(2.2) (f,T n t g) = f*~g{-nt ) VneZ 

where g denotes the function g = g(—t). Thus the coefficients of the expansion are 
the samples of the function / * g in — nt Q . The elements of $ are called generators 
and the elements of $* dual generators. If the family E$,, to is a frame for H and 
the operator T $ t is injective, then E&. to is called a ffiesz 6asis. 

In what follows t a is a positive parameter. To simplify notation, throughout the 
paper we shall set 
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A subspace S of L 2 (K) is i -shift-invariant if it is invariant under all translations 
by a multiple of t a . The following bracket product plays an important role in Ron 
and Shen's analysis of shift-invariant spaces. For / and g G L 2 (M), define 

[f,g] = hJ2f(-+3h)g(-+jh). 

Note that [/, g] is in L\ and ||[/, = The Fourier coefficients of [f,g] are 

given by 

[f,gf(n) = / Vr iA (/I)(x)e- 2 ™srfx = (f,r nto g) 
Jo j 

(2.3) = / * g{-nt Q ) Vn e Z. 

If S is a i Q -shift-invariant space and there exists a finite family $ such that S is the 
closed linear span of -E*,t„, then we say that S is finitely generated. Riesz bases 
for finitely generated shift-invariant spaces have been studied by various authors. 
In |BDR) the authors give a characterization of such bases. A characterization of 
frames and tight frames also for countable sets $ has been given by Ron and Shen 
in |RSj . The principal notions of their theory are the pre-Gramian, the Gramian 
and the dual Gramian matrices. The pre-Gramian J $ t is the /i-periodic function 
mapping R to the space of oo x TV-matrices defined on [0, h] by 

(2.4) (Jz ito ). i (x)=Vhw(x + jh), j eZ,i=l,...,N. 

The pre-Gramian J $ t should not be confused with the matrix-valued function 
whose entries are ^fJiLp}(x + jh), for all x € R, which is not periodic. Denote by 
J|, t the adjoint of J $ t . The N x N Gramian matrix G$,$«, to = J|, t J $ , t plays 
a crucial role in the recovery of missing samples; its elements are the /i-periodic 
functions 

(2-5) (G^,t ) ji =M,'Pj]- 
We set 



£ = 



1. 



~U)~ 

.h. 

where [a] denotes the greatest integer less than a. In [DP, Corollary 2.3] we found 
the length of B u , as £ -shift-invariant space: 



(2.6) lenJSJ 



if f < h< ^ 
1 if j^r < h < 



We also gave necessary and sufficient conditions for Eg, yto to be a Riesz basis or a 
frame for |DPI Theorems 3.6, 3.7]. The result is based on the analysis of the 



structure of the matrix t ; we restate it below in Theorems |2.1| and |2.2| for the 



sake of the reader. 

Strictly speaking, the pre-Gramian J $ t is an infinite matrix. However, in DP 
Lemma 3.3] it has been shown that if $ is a set of generators of B^, then all but 
a finite number of the rows of J$.t Q vanish; hence we may identify it with a finite 
matrix. Indeed, consider separately the two cases u/l < h < uj/(£ — 1/2) and 
u/(£- 1/2) <h< lj /{£-!). 
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Assume first that u/l <h< lu/(£- 1/2); then < -ui + £h < uo - (£ - l)h < h. 
We denote by I_ , I, I + the intervals defined by 

/_ = (0, -uj + ih), I=(-u + £h,u-(£-l)h), I+=(u-(£-l)h,h). 

By ([2~6]) lcn to {B u ) = 2£; if $ = {ip 3 : 1 < j < 21} is a subset of B u of cardinality 2£, 
by [DP, Lemma 3.3] all the rows of the matrix t vanish, except possibly the rows 
(i~jh<Pi, T jh<?2, ■ ■ ■ , T jh<?2e), — £ < j < t- — 1- Thus we identify the infinite matrices 
t > J<t>* t > their adjoints and the matrices G$^ o , G$ t <s,* t t with their 2£ x 21 
submatrices corresponding to these rows. The i-th column of J $ t , 1 < i < 2£ is 



(2.7) y/h 







T (l~l)h<?i 



in /_ 



T-lhfi 
T-(£-l)/i<Ai 



T(i~2)h l Pi 
T(l~l)h<?i 



in I 



<4>i 



T(l-2)hVi 





in I4 



(see Lemma 3.3 in [DP). The same formulas hold for the matrix J $ » t , with ip 
replaced by ip*. We note that the matrices G$ i t o and J$ t have the same rank. 
Let A be a n x m matrix with complex entries, n < m; we shall denote by \\A\\ the 
norm of A as linear operator from C m to C™ and by [A] n the sum of the squares of 
the absolute values of the minors of order n of A. 

Theorem 2.1. (DPj Theorem 3.6] Suppose that to/£ < h < u/(£-l/2). Let 
<1> = {ipj :l<j< 2£} be a subset of B^. Then E$ to is a frame for B^ if and only 
if there exist positive constants S, 7, a and r/ such that 



2C 



(2.8) 



< 



(2.9) 



<s>.t„ 



> a 



a.e. in 7_ U /+, 



(2.10) 



|det J* t J > r\ 



a.e. in I. 



If h — lj / £ the intervals J_ and I + are empty. In this case -E$,t D is a Riesz basis 
for B u if and only if conditions i2.£ty and (2.10) hold. 



Next we consider the case u/{£- 1/2) < h< uj/{£- 1). Then < w-(t-l)h < 
—uj + £h<h;m this case we denote by K_,K, K + the intervals defined by 

(2.11) if_ = (0,(j-(£-l)h), K = (u — (£—l)h, —uj+th), K + = (-u+£h,h). 

By ([2J]) len to (B u ) =21-1. Let $ = {<fj : 1 < j < 2£ - 1} be a subset of B u 
of cardinality 2£ — 1. By |DP[ Lemma 3.3] all the rows of the matrix J $ t , except 

possibly (Tjhipi, Tjhtyii ■ ■ ■ , Tjh<P2i), — £ < j < £ — 1, vanish. Thus we identify the 
infinite matrices J $ t , J $ , t , their adjoints and the matrices G$ i t o , G<&^*^ with 
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their 2£ — 1 x 21 — 1 submatrices corresponding to these rows. The i-th column of 



J^t , 1 < i < 2^ - 1 is 



-{l-X)hM>% 



(2.12) Vh 



<Pi 



T(t-\)h<Pi 



-(Jt-l)h(Pi 



T(l-2)h l Pi 





K Vh 



r(£-2)h<fi 



W.K+. 



Theorem 2.2. |DPj Theorem 3.7] Suppose that w/(£-l/2) < h < u/(£-l), 
I 7^ 1. Let $ = {tpj :1 < j < 21 — 1} be a subset of B u . Then -E$,t is a frame for 
B u if and only if there exist positive constants 8, 7, a and r\ such that 

21-1 

(2.13) 8 < lv?j| 2 < 7 a - e - in- 

(2.14) [J*, t J 2l _ 2 >cT a.e.inK, 

(2.15) I det J $ t J > 7? a.e. in K- U 

If h = ui/(£— i) the interval K is empty. In this case E& t t o is a Riesz basis if and 



only if conditions (2.13) and (2.15) hold. 



3. Recovery of missing samples 

In this section we consider the problem of reconstructing a band- limited function 
when a finite set of samples is missing. Let t a be a positive real number and L 
the length of B u as i D -shift-invariant space. Let <I> = {(pi, . . . , (p^} be a set of 
functions in B u such that is a frame for B^. Then any function in B u can 



be reconstructed via the syntesis formula (2.1|. We recall that the coefficients of 
the expansion are the samples of the functions fj — f * <fij at integer multiples of 
t a and we may rewrite (|2.1[) as 



(3.1) / = E E fj(nt )T- nto <P* V/ e B u . 

j=l nSZ 

The recovery of lost samples in band-limited signals has already been investigated 
by Ferreira for the classical (one-channel) Shannon formula [FJ , and by Santos and 
Fcrrcira for a particular two-channel derivative sampling [SF . In the latter article, 
the authors show that a finite number of missing samples of the function or its 
derivative can be recovered. In |KK] Hong and Kwon have generalized these results 
to a two-channel sampling formula, finding sufficient conditions for the recovery 
of missing samples. In both papers |SFI IKK) , the authors work with particular 
reconstruction formulas, obtained by projecting Riesz basis generators of B u and 
their duals into the space B UJa with Lu a < lu. With this technique the projected 
family is a frame; note that projecting the dual of a Riesz basis does not yield 
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the canonical dual. In particular, the coefficients of the expansion of a function 
computed with respect to the projected duals are not minimal in the least square 
norm. 

We find sufficient conditions such that, if E^ to is a frame (and not a Riesz 



basis), any finite set of missing samples may be recovered (see Theorems 3.4 and 
3.5 below). 



In the recovery of missing samples the structure of the mixed Gramian matrix 
G$,$*,t = J$ i J<j,* t plays a crucial role. Propositions 3.1 and 3.2 below show 
that, a.e. in the interval [0, h], the matrix I — G$.$».f o is either the identity or a 
projection on a subspace of codimension one. To prove them, we recall some matrix 
identities obtained in [DP . By formula (4.2) in [DP 



(3.2) 



Under the assumptions of Theorems 2.1 or 2.2 the interval [0, h] is the disjoint 



union of three intervals where the pre-Gramian is either invertible or has rank L — 1. 



Where the pre-Gramian is invertible one can solve for t in (3.2 1, obtaining that 



(3.3) 



In the intervals where the pre-Gramian has rank L — 1, either its first or last row 



vanishes; this happens in the intervals i_U/ + in formula (2. 7 1 and in the interval K 



is the Moore-Penrose inverse (J^ t )t of JJJ t , we have that 



in (2.12 1. We shall denote by J$,t D and J $ * t the (L— 1) x L submatrices of t and 
J $ « t obtained by deleting the vanishing row. In this case G$,$*,t o 
Since J $ , t 

(3.4) <j-$,**,t„ — «"$,t 

We refer the reader to [BIG] for the definition and the properties of the Moore- 
Penrose inverse of a matrix. 

We shall denote by W the cross product of the rows of the matrix /i _1 / 2 J$.t D . 
We observe that, if u/(£-l/2) <h< 1), £ ^ I, then 



G*.**,t o — J$ t (J$ t ) ■ 



w = X Tjh $ 

j=-e+i 

while, iiu)/£ <h< lo/(£- 1/2), then 



a.e. in K: 



1-2 



w 



X T jh % 
j=-l+l 



W = X T, a.e. in Ij. 



Observe that, since W is orthogonal to the rows of J$, t 
then Ker J$ )to = span(W). 

We denote by /„ the n x n identity matrix. Given a vector v S 
by P v the orthogonal projection on v in C". 



and dim Ker J$ jto = 1, 
we denote 



Proposition 3.1. Let w/{£ - 1/2) < h < w/{£ - 1), £ ^ 1 and Zei $ 

{Vji 1 < j < 2£ — 1 } oe a subset of B u . If E$ to is a frame for B u then 



(3.5) 



G 



2e-i 



a.e. in K- U K + , 



(3.6) 



G, 



a.e. in X. 
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Proof. By (2.151, the pre-Gramian J|, t is invertible in the intervals K— and K + ; 



hence formula (3.5) follows from (3.2). Consider now the interval K. By (3.4 1 and 



the properties of the Moore-Penrose inverse, G$,$*,4 is the orthogonal projection 
on Ran($Q t ) in C — On the other hand, since J$,* has maximum rank, 

span(W) = Ker(I^. to ) = R an (^%,t ) ± ■ 
Hence the projection on Ran(S§ t ) is I21-2 



Pw This proves (3.6) 



□ 

A similar argument yields 

Proposition 3.2. Let w/i < h < - 1/2) and let $ = {ipj, 1 < j < 21} be a 
subset of B u . If E$ to is a frame for B^, then 

(3.7) G$,$»,t o = l2£ a.e. in I 



(3. 



G 



121 



P„ 



a.e. in /_ U i+. 



Let I = {£i,l2, ■ ■ ■ , £n} be a given set of integers. We give sufficient conditions 
to reconstruct the missing samples 

(3.9) f 3 {nt ) n£l, 1 < j < L. 

Theorem [3~4| deals with the case oj/{£ — 1/2) < h < u/(£—l), i.e. L = 21 — 1, while 
Theorem 3.5 deals with the case ui/£<h<ui/(£— 1/2), i.e. L = 21. 
The sufficient conditions are expressed as the linear independence of the components 
of the vector W over the set P%,h of trigonometric polynomials of the form 



Pit) 



N 



Definition 3.3. A finite family {Fj,j = 1, ... , to}, m € N, of functions is Px,h~ 
linearly dependent on a set Cl C [0, h] if there exist non-zero trigonometric polyno- 
mials Pi,P2, ■ ■ -Pm, in Pz,h such that 



(3.10) 

If X = (Xl, X2, ■ ■ ■ 

polynomial in P^,h 



E 

k=l 



Pj(t) Fj(t) = for a.e. t E Cl 

, xn) is a vector in C N , we shall denote by x the trigonometric 



(3.11) 

If X = (xi,x 2 , 
(3.12) 



x(<) = > .." < 



N 

£*3< 
3=1 



t E 



, Xij with xj E C for j = 1, . . . , L, we write 
X(i)= (xT(t),xJ(t),...,x£(t)) ten 



Thus I h maps vectors in 



-*NxL 



to vectors in C L for a.e. t E 



Theorem 3.4. Suppose that the assumptions of Theorem \2.2\ are satisfied with 
h =/= — 1/2). Let X C Z be an assigned finite set. If the components of the 
vector W are Pj ^-independent on K , then for every f E B u it is possible to recover 
the samples fj(nt ), n EI, 1 < j < 2i — 1. 
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Proof. Let X = {£1,(2, ■ ■ ■ An}- By convolving with (p k both sides of expansion 
formula (3.1 1, where L = 21 — 1, and evaluating in £ m t 01 we get 

2£-l 

fk(tmto) = X! X! fj( nt °) (Vj * &k){£ m to - Tit ) 
3 = 1 nSZ 

k = 1, ... ,21 — 1, m = 1 . . . , AT. Next we isolate in the left hand side the terms 
containing the unknown samples 

22-1 N 

fk(£ m t )~ ^ yifjjtpto) [tf * Vk){i m to ~ ipto) 

3=1 p=l 

(3.13) 

2t-l 

= ^2 ^2 fj{nt ) (<p* * <Pk)){t m to ~ nt ) 

3=1 ngT 

k = 1, . . . , 21 — 1, 1 < m < N. This is a system of N(2£ — 1) equations in the 
N{2£ — 1) unknowns fk(£mt )- To write it in a more compact form, we denote the 
unknowns by Xj(m) and the right hand side of equation (3.131 by b k {m), i.e. 

Xk(m) = fk(£ m t ) 

21-1 

b k (m) = ^ X! /j( rrf °) * Vk)(£ m t - Tito), 

3 = 1 ngl 

for 1 < k < 21 - 1, 1 < m < N. Next, we write 

x fc = (x k (l),...,x k (N)), b k = (b k (l),...,b k (N)) 

and 

X = (xi, . . .,X2t-i), B = (bi, . . .,b 2 e-i). 
We introduce the block matrix 

S11 S12 ■ • • Si(2e~i) 
S21 S22 



(3.14) 



S(2(-l)l S(2i-1 



(21-1)2 



'2(2^-1) 



S(2l-l)(2t-l), 



where the S k j, 1 < j, k < 2t — 1, are the submatrices whose entries are 



(3.15) 



Sfcj (m, p) = ((^* * ip k ) (£ m t - £ p t ) 



m,p = 1, 



Thus the equations in (3.131 can be written 
(3.16) (I-S)X = B 

where X and B are vectors in C^ -1 ) and I is the N(2£-\) x jV(2 l - 1) identity 
matrix. Thus the missing samples can be recovered if equation ( |3.16 1 can be solved 
for all B, and this happens if and only if 1 is not an eigenvalue of S. 
We shall prove that if 1 is an eigenvalue of S, then the components of the vector 
W are Px,fi _ dependent on K; thereby contradicting the assumptions. Consider the 
quadratic form X* X — X*SX, where * denotes conjugate transpose. We claim 
that for all X e C N ^- 1 ) 



(3.17) 



X*X - x*sx 



K 



(hi-i - G^^, to {t))x{t) 



dt. 



C 2t-1 
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where X is given by (3.121 with L = 21— 1. Indeed, by (2.3 1, the (m,p)-entry of 
the matrix Skj in (3.151 is 

S kj {m,p) = \ [ mSkMe^-^dt m,p = l,...,N. 



Hence 



2£-l N 

X*SX= ^2 E x 3 (m) S jtk (m,p)x k (p) 

j,k—l m,p— 1 
2(-l N h 

=lH E / [^,^](*)e i(< "- < ' )t -*d*ar fc (p) 

j.k—l m,p—l ^ 



„h 2£-l AT N 

W EE 5iMe^ M [^^](t) E ^(p) 

■'° j,fclm=l p=l 



e -itpt t dt 



X*(t) G^, tto {t)X(t) dt. 







The last identity follows by (2.5 1. Thus, by the Parseval identity 



x*x = 



X*(t)X{t) dt 



and the fact that G<i, i $* ito (i) is an orthogonal projection for almost every t £ [0, ft], 
we obtain 

X*X - X*SX =^ / Z*(t)^-i-G$, # , jt<) (t))x(t) dt 



1 
1 

^ Jo 



X*{t)(l2i-i-G^ ita (t)) x (t) dt 



(ht-i-G^*, to {t))X{t) 



d,t. 



Formula ( |3.17[ ) follows by observing that, by ( |3.5[ ), the integrand is zero in 
K_ U K + = [0, ft] \ K. 

Assume that 1 is an eigenvalue of the matrix 5. Then, by (3.171, there is a vector 
X° = (xf, . . . ,x^_!) in C^^ 2 ^ 1 ), X° ^ 0, such that 



(3.18) 



{ht-x ~ G^, jto (t))X°(t) = for a.e. t e K. 



Since ht-i — G $ t = P w a.e. in K, by Proposition 3.1 the vectors X°(t) and 
W(t) are orthogonal for a.e. t in K, i.e. 

2£-l 

= ° for a - e - 1 in 

i=i 

Since x°(t) 6 Pj./j , 1 < j < 2£ — 1, this implies that the components of W are 
Pjr ^-dependent. □ 

Remark. If the matrix S is Hermitian, the condition in the previous theorem is also 
necessary. Indeed, assume that the components of W are Pj^-linearly dependent 
on the interval K. Then there exists a non-null vector X° — (x°, x^, . . . x° 2< _^) 



FRAMES FOR BAND LIMITED FUNCTIONS 



11 



in C"' 2 ^ 1 ) such that X° is orthogonal to W in K. Thus P W X° = 0; since by 



(3.61, P, 



'2.0-1 



G 



the identities (3.171 and (3.181 imply that X°*X° 



X° SX° — 0. Hence, since the matrix / — S is Hcrmitian and the associated 
quadratic form is positive scmidefinitc, X° — SX° = 0, i.e. 1 is an eigenvalue of S. 



Theorem 3.5. Suppose that the assumptions of Theorem \2.1\ are satisfied with 
h =/= lu/£ and let X C Z be a finite assigned set. If the components of the vector W 
are P x ,h-independent on J_ Ui+, then it is possible to recover the samples fj(nt ), 
n€X,'l<j <2£. 

Proof. Let X = {£\, I2, ■ ■ ■ , ^n}- As in the proof of the previous theorem, we write 



the system as in (3.161, where the block matrix S is now 

'£11 
S2 1 

S 



51 2 

52 2 



51 21 

52 2£ 



_D2tl S2I2 ' ' ' S2£2£_ 

and the entries of the submatrices Skj k,j= 1, . . . , 2£ are as in (|3.15|. By arguing 



as in the proof of (3.171 and using ( 3.8 1 instead of (3.6l, we get 

1 



X*X - X*SX = 



/_UJ. 



+ 



[ht - G^. >to (t))x(t) 



dt 



for all X e 
theorem. 



l N2e . The conclusion follows by the same arguments of the previous 

□ 



Next we consider the case where the samples to reconstruct concern a number A 



of generators less then the length of the space B u . In Corollaries 3.6 and 3.7 below 
we find conditions such that reconstruction is possible. By renaming the generators, 
we can assume that the missing samples are relative to the first A generators. 



Corollary 3.6. Assume that the assumptions of Theorem \ 2.S\ are satisfied with 
h ^ <j) j(t — 1/2). Let X C Z be a finite set and let A be such that 1 < A < 2£ — 1. 
// the components of index 1, 2, . . . , A of the vector W are P% ^-independent on K, 
then it is possible to recover the samples fj(nt ), n € I, 1 < j < A. 



Proof. Let X = {^1,^2, • • ■ ,^jv}. Starting from (3.131 and moving to the rigth hand 
side the terms containing the known samples, we obtain 

A N 

fk(£ m t ) - X! fiitpt") {'Pi * &k){Z m t - £ p t ) 
j=i p =i 

A 

= )] / Ifj (nt a ) (<pj * <Pk) {£ m t - nt ) 
3=1 rigX 
21-1 

+ ^2 ^ fj( nt o) {<Pj * <Pk)(£ m to - nt ). 

3=X+1 nSZ 

Denoting by the right hand side we get 

A N 

(3.19) fk(t m t ) - y^^] fj{tpto) {<Pj * <?k)(e m t - i P t ) = h(m) 
j=l p—1 
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l<fc<A,l<m<7V. As in the proof of Theorem |3.4| we regard these equations 
as a system in the unknowns /(.(f m t„), 1 < m < N, 1 < k < A. To write it in matrix 
form we denote the unknowns by z k (m) and we write 



Zfe 



(z k (l),...,z k (N)) 



(Mi),. 



and 



Z = (zi, . . . ,z A ) .B = (bi, 
Then the equations in ( 3.19| can be written 

(3.20) (I - S [x] ) Z = B, 



,b k (N)) 
..,b A ). 



1 < k < A 



where S^ is the block matrix obtained from the matrix S in (3.141 by eliminating 
the blocks Sj k with j and k greater then A, I is the NX x NX identity matrix, and 
Z and B are in C NX . It is possible to recover the missing samples if (3.201 can 
be solved for all B and this happens if and only if the coefficient matrix / — 
is invertible , i.e . if and only if 1 is not an eigenvalue of S^. As in the proof 
of Theorem 



3.4 we shall show that, if 1 is an eigenvalue of S^ x \ then the first A 
components of the vector W are Px, /independent on K. 

Denote by Q the projection on C^t 2 ^ 1 ) mapping the vector X = (x 1; . . . , x 2 ^_ 1 )) 
to QX = (xi , . . . , xa , 0, . . . , 0) . We identify the operator Q with the matrix 



\h 


" 









where I\ is the A x A identity matrix. We observe that 1 is an eigenvalue of iff 
it is an eigenvalue of QS with eigenvector X a £ Ran(Q). 

Next assume that 1 is an eigenvalue of the matrix S^. Then 1 is an eigenvalue 
of QS and there exists a non-null X a 6 Ran(Q) such that X a — Q S X a = 0; i.e. 
QX -QS QX = 0. Hence X a * QX a -X* Q QS QX Q = 0. This can be written 

(QX )*QX - (QX )*SQX = 0. 

By applying ( 3.17[ ) with X = QX a we get 

(he-i - G $ 9 , to ){QX ) = a.e.in K. 



By (3.6) it follows that P W {QXT) = 0, i.e. QX D (t) = QX D (t) is orthogonal to 



W(t) for a. e. t in K. This shows that 

A 

y2x^j(t)Wj(t) = for a.e. t in K. 

3 = 1 

We have thus proved that if 1 is an eigenvalue of S^ x \ then the first A components 
of W are Px,/t"dependent on K. □ 



Corollary 3.7. Suppose that the assumptions of Theorem 2.1 are satisfied with 
h ^ u>/£. Let X he an assigned finite set and A be such that 1 < A < 11. If the 
components of index 1, 2, . . . , A of the vector W are Pj ^-independent on the interval 
I- U I + , then it is possible to recover the samples fj(nt a ) b£I, 1 < j < A. 



We omit the proof since it is quite similar to that of Corollary |3.6 
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4. Recovery of missing samples in the derivative sampling 

This section is dedicated to derivative sampling and to the recovery of missing 
samples in the corresponding reconstruction formulas. Fix an integer L > 1 and let 
$l = (ifi, • • • , ipl) be defined by 

(4.1) <pi = X[-u,w]' & = ixx[- u ,u], •■•,<Pl = (ix) L ~ 1 X[-u,u]- 

It is well known that if h — 2u>/L, i.e. if t a — -kL/lj, the family E& Ll t„ is a 
Riesz basis for and in the reconstruction formula for a function / G B w the 
coefficients are the values of / and its first L — 1 derivatives at the sample points 
(see for example |HSj . [Hijl. 

In the first part of this section we show that E$, Lt t is a frame for B^ for any 
h E [2u/L,2u)/(L — l)) i.e. for any t Q € ((£ - l)n/u, Lir/u] (see Theorem [4~2 1 . 
We need a lemma. Denote by M n the n X (n + 1) matrix 

1 r h (ix) T h {ix) 2 . . . T h (ix) n 



(4.2) 



M n (x) = 



1 T nh (ix) T nh (ixf 



Tnh(ix) 7 



Lemma 4.1. Let M n 



r — 0, 1, . . . , n be the submatrix of M n obtained by sup- 



pressing the r-th column. Then the determinant of M„ tr is a polynomial of degree 



Proof. First we observe that M n _ n is a Vandermonde matrix. Thus 



(4.3) detM„, n = [] {r jh (ix)-r kh (ix)) = (ih) n ]J (j-k) = (ih) n J] p\ 

X<k<j<n l<k<j<n p=l 

is a constant. Next we show that 

(4.4) (detM n , r )' = i(r + 1) detM n , r+1 r = 0,...,n-l. 

We recall that the derivative of the determinant of a n x n matrix is the sum of n 
determinants, each obtained by replacing in the matrix the elements of a column 

= n — 1, i.e. for the matrix 

T h (ix) n 



by their derivatives. First we prove formula (4.4 1 for r 
"1 T h (ix) ... r h (ix) n - 2 



(4.5) 



M, 



n,n— 1 



1 r nh (ix) ... T nh (ix) n 2 r nh (ix) n 

We observe that the derivative of the entries of the first column is zero and that for 
j = 1,2, ... ,n — 2 the derivative of the j-th column is a multiple of the preceding 
column. Hence the determinants of the first n — \ matrices vanish. It remains only 
the matrix obtained by derivating the last column. Therefore 

1 r h (ix) ... T h (ix) n ~ 2 inThiixY 1 ^ 1 



(detAfn.n-0' = 



1 T nh (ix) 



T n h{ix) n 2 inT n h(ix) 7 



= indetM n n . 
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Hence we have proved formula (4.4 I for r = n — 1; the proof for r = 0, 1, . . . ,n— 2 
is similar. By (4.3 1 and (14. 41) the lemma follows. □ 



Theorem 4.2. Let <1>l = </?2, ■ • ■ , <Pl) be as in (4-.1 )■ Ift a is a positive number 
such that (L — 1)tt/lo < t Q < Ltt/lu, then E$ L . to is a frame for B u . If t Q = Ltt/lo 
then E<£, L to is a Riesz basis for B^. 

Proof. We shall prove the theorem only in the case L odd. The proof in the case 
L even is similar. If L = 2£ — 1, then u>/(£ — i) < h < uj/(£ — 1), since h = 
2ir/t . We show that the assumptions in Theo rem 2.2 are all satisfied. Indeed, 
since Y^f=\ \<Pj\ 2 — Y^f=o x ^ \ condition ( 2.13| is satisfied. Next we prove that 
there exists a positive number a such that ( 2. 14 1 holds. By (2.121, in the interval 
K the matrix obtained by deleting the vanishing row in the pre-Gramian is the 
{21-2) X (21- 1) matrix 



(4.6) 

i.e. 
(4.7) 



J $ , t (x) =Vh 



\2l-2 



.1 T{jt-2)h{iX) 



T-(e-i)h(ixY 
T(e-2)h(ix) 2e ~ 2 



By (4.31 the (2£ - 2) x (21 - 2) minor of J $ 
column is 



J$. ito (x) = Vh T th M 2l -2(x)- 

obtained by suppressing the last 



^- 1 detM 2 ,_ 2 , 2£ _ 2 (x) = (-if^h 



li 3£-3 



21-2 

IL 



Va: € 



We recall that [ J $ to ] 2£ 2 is the sum of the squares of the absolute values of the 
minors of order 2^ — 2: hence 



[J* 



• to ht-2 



> h 



6(1-1) 



21-2 

p=l 



> 



in K. 



This shows that (|2.14| is satisfied. Next we consider the interval K^; here by (2.12) 

fh T-th M2Z-1M-1- 



and (4.11 



J, 



By (4.3) its determinant is 



2i-l 



detJ^ to (x) = (-l) e+1 ih u -*l 2 J] Pi 

p=l 



The sam e fo rmula holds in K + . This proves (|2.15l 
Theorem 



2.2 



Thus the assumptions of 
are satisfied. This concludes the proof for the case oj/£ < h < uj/ (I— \ ) . 



1/2), then the interval K is empty. By arguing as before, one can 



If h 

show that ( |2.13| and ( |2.15[ ) hold on the intervals K_ and K + . Hence, by Theorem 
2.21 t is a Riesz basis. □ 



Denote by Q* L = (ip*, . . . , <p* L ) the canonical dual generators of the frame E& Lt t . 
By Theorem |4.2[ every / 6 B w can be expanded in terms of the elements of the 



dual family as in (3.1 1. By (4.1 1 the coefficients of this sum are 

f,(nt ) = V2n (-ly^f^inQ n g Z j = l,. 
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Hence 

L 

(4.8) f{x) = V2ttJ2 E^ 1 )^ 1 /°' _1) (^o) - nto) V/ e B„, 
where L = 21 if w/^ < /i< w/{£-l/2) and L = 2£-l if w/ {1-1/2) <h< u /{£-!). 



We shall call (4.8 I the derivative oversampling formula of order L — 1. 

Proposition |4.4| below shows that, for band- limited signals, it is possible to re 



cover any finite set of missing samples in the derivative sampling expansion (4.8 1. 
Thus we generalize to arbitrary order the result of Santos and Ferreira in |SF| . We 
need a lemma. Denote by dP the degree of a polynomial P. 

Lemma 4.3. Let Pi, i = 1, 2, . . . , N , be non-null polynomials such that 

dP 1 >dP 2 > > dP N . 

If yif—i IjPj = f or some continuous h-periodic functions ji, i — 1, 2, . . . , N, then 
7j = for all i= 1,2,..., N. 

Proof. The case N = 1 is obvious; assume by induction that the statement is true 
for N polynomials. Let Pi, i = 1, 2, . . . , N + 1, be non-null polynomials such that 

dP 1 >dP 2 > > dP N > dP N+ i 

and 

7i Pi + J2P2 + + InPn + 7AT+1-FV+1 = 0. 

Denote by q be the degree of Pi. By dividing by x q and taking the limit to infinity, 
we obtain that 71 is identically zero. Hence SjlJ 1 IjPj = 0- The conclusion follows, 
by the inductive assumption. □ 



Proposition 4.4. Let = (ipi, ip2, ■ ■ ■ , <Pl) the frame generators defined by (4-1) 



If (L — 1)tt/u> < t a < L tt/lu, then in the sampling formula (4.8) it is possible to 
recover the missing samples 

f U \nt ) nei, l<j<L-l, 

for any finite set X C Id- 
Proof. We shall only prove the theorem when L is odd. The proof for L even is 
similar. Let L = 21 — 1; then u>/{£ — 1/2) < h < u>/{£ — 1), by the assumption 

on t a . We recall from Section |3] that W denotes the cross product of the rows of 

1 t ' — ' 

/i _5 J$,t o ; thus, up to a sign, its components Wk are the minors of order 21 — 2 of 



h 2 J$,t - By Theorem 3.4 it suffices to prove that the components of the vector 



W are P Xi ^-independent on K for any finite set X ■ By (4.7) and Lemma 4.1 Wk is 
a polynomial of degree 21 — 1 — k for k = 1, 2, . . . 21 — 1. Thus 

dW x > dW 2 > > dW 2 i-i- 

Let now pi,p 2 , ■ ■ ■ ,Vii-i be trigonometric polynomials in P-x.h such that 

2Z-1 

Pj {t)W j {t) = 0, teK. 



By analytic continuation, this identity holds on R. Thus, by Lemma 4.3 Pj = for 



all j — 1, . . . , 21 — 1. This concludes the proof of the proposition. □ 
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5. The first order formula: explicit duals and numerical 

experiments 



Obviously in applications, to use the recontruction formula (4 
to find the dual generators tpi* 



it is necessary 



. , tp* L . When L = 2, 3 we gave an explicit expres- 
sion of the Fourier transforms of the duals in terms of the Fourier transforms of 



the generators in(see Corollaries 5.2 and 5.3 in |DPj ). For greater values of L one 
can use the general formulas given in Theorems 4.6 and 4.7 in |DPj . In this section 
we provide an explicit espression of the duals for the first-order derivative formula 
(L = 2) (see ( 5 .2 1 ) and we present a numerical experiment of recovery of missing 



samples and reconstruction of a signal. 



Let ipi, if2 be the functions defined in (4.1 1 for L = 2 



<Pi = X[-u>M 



ip 2 = tXX[- u ,u]- 



By Theorem 4.2 E<s> t t„ i s a frame for B u if lu < h < 2lu; if h = w then it is a Riesz 



basis for B u . The sampling formula (|4.8| reduces to 
(5.1) 



/ = V2tt^ f(kt )r-kt f* - f(kt )T- kto (p2- 



A-e: 



The Fourier transforms of the dual generators are 
'i(l-M) h -u<\x\<. 



ip\{x) 



<h 



tp*(x) 



^(l+a: 2 ) |*| ^ ■« * (h{l+x 2 ) 

(see Corollary 5.2 in [DP])- Figure 1 shows ip*, <f>\ for h = 1.6 lu 



A sign(a;) h — to < \x\ < to 
\x\ < h — lu 



Figure 1: The Fourier transforms of the duals for h — 1.6 n. 



By Fourier inversion 



lpI(x) 



(5.2) 



Lp*(x) 



1 



2lu 



H(smc(ujx) — sinc(iJa;)) 



\t\<H 
2 

Y 2 



l + < 2 



dt 



h 2 x 2 



(cos(Hx) — cos(lux)) 



(cos(wx) — cos(Hx)")x 1 + — 



0<\t\<H 



1 + t 2 



dt 



where H = h — lu and sine = sin(a;) jx. . The integrals in the right hand side of this 
formula can be written as linear combinations of sine and cosine integrals, so that 



FRAMES FOR BAND LIMITED FUNCTIONS 



17 



it is possible to implement the duals without any approximation. Observe that if 
h = lu then 




Following Ferreira, we have chosen the test function 

(5.3) f (x) = sinc(7r(x - 2.1)) - 0.7sinc(7r(a; + 1.7)) 

plotted in Figure 2. In general, redundancy makes frame expansions robust to 




Figure 2: The function f a in [-20,20]. 



errors like noise, quantization and losses. However, for this derivative frame, even 
the reconstruction of a signal where only two samples are missing may lead to poor 
results. To ill ustra te this point, we have reconstructed the signal f Q in (5.3 1 by 
using formula (5.1l, when the samples f (4± o ) and f„ (4t D ) are set to zero: 

fo* = V2TT ^ fp (kt )T-kt yj - fo ' (kt )T^ kto lf2. 

Figure 3 shows the functions f a * and f a in the interval [—10,10]. 



Figure 3: The functions /„* and f in [—10, 10]. 



In our experiment we assume that 10 samples of f Q and f a are unknown and we 
recover them by solving the 20 x 20 system (3.161. Then we obtain the recon- 
structed function f c via formula (5.1 1, where the missing samples are replaced by 
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the computed ones. We suppose that the missing samples are {f (£kt ), /o'(^fcio), 
k = 1,2, ... , 10}, where 1% — —16 + 3(/c — 1). We have obtained the computed 
samples with an error of order 10 and a relative error of order 10 -2 ; the graph 
of the reconstructed function f a c is undistinguishable from that of f . 
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